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(54) A particular pattern of pixels for a color filter array which is used to derive luminance and 
chrominance values 

(57) A color filter array tor an image sensor which 
has a plurality of pixels is disclosed. The color filter array 
includes a plurality of color pixel kernels, with each ker- 
nel having a plurality of pixels arranged in the following 
pattern 
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FIG. 2 



wherein: 



M is magenta; 
G is green; 
C is cyan; and 
Y is yellow. 
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Description 

In electronic color imaging, it is desirable to simultaneously capture image data in three color planes, usually red, 
green and blue. When the three color planes are combined, it is possible to create high-quality color images. Capturing 

5 these three sets of image data can be done in a number of ways. In electronic photography, this is sometimes accom- 
plished by using a single two dimensional array of sensors that are covered by a pattern of red, green and blue filters. 
This type of sensor is known as a color filter array or CFA. Below is shown the red (R), green (G) and blue (B) pixels as 
are commonly arranged on a CFA sensor. 

When a color image is captured using a CFA, it is necessary to interpolate the red, green and blue values so that 

10 there is an estimate of all three color values for each sensor location. Once the interpolation is done, each picture ele- 
ment, or pixel, has three color values and can be processed by a variety of known image processing techniques 
depending on the needs of the system. Some examples of the reasons for processing are to do image sharpening, color 
correction or halftoning. 

The diagram below shows how red green and blue pixels can be arranged in a particular color filter array pattern, 
15 hereinafter referred to as the Bayer color filter array. For a more detailed description see US-A-3.971 ,065. 



20 



G 


R 


G 


R 


B 


G 


B 


G 


G 


R 


G 


R 


B 


G 


B 


G 



25 

Adaptive methods of calculating green pixel values at pixels where green is not directly measured produce better 
reconstructions for horizontal and vertical features than they are for diagonal features in the image. This is because 
there are green pixels in every row and every column of the CFA. However, every other diagonal in the CFA is devoid 
of green pixels. With this arrangement, the frequency response on diagonals is less than that on horizontal rows and 
30 vertical columns. As a consequence, diagonal edges are less sharp than horizontal and vertical edges. Moreover, inter- 
polation of green values in the diagonal direction is not available. It would be desirable to have a CFA pattern in which 
diagonal interpolation, in addition to horizontal and vertical interpolation, would be available. 

It is an object of the present invention is to provide a color filter array pattern which provides signals which can be 
efficiently processed. 

35 It is a further object of the invention to have a CFA pattern in which diagonal interpolation, in addition to horizontal 
and vertical interpolation, is available. 

This object is achieved in a color filter array for an image sensor which has a plurality of pixels, a color filter array 
comprising: 

40 (a) a plurality of color pixel kernels, with each kernel having a plurality of pixels arranged in the following pattern 
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(i) wherein X1 and X2 respectively represent luminance values wherein the sum of their individual colors are 
so luminance and the difference of their individual colors are chrominance; and 

(ii) wherein Y1 and Y2 respectively represent luminance values wherein the sum of their individual colors are 
luminance and the difference of their individual colors are chrominance. 

This invention permits non-linear interpolation of luminance values in not only horizontal and vertical but also in 
55 diagonal directions, regardless of location within the CFA pattern. 

Another advantage of the present invention is that the same processing can be used irrespective of the location of 
the pixels in the CFA. 

Another advantage of the present invention is that it facilitates the use of the smallest kernel of CFA pixels can be 
used to provide a high quality estimate of luminence. 
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FIG. 1 is a plan view of a generalized kernel of a color filter array in accordance with the present invention; 

FIG. 2 is a plan view of a particular embodiment of a kernel of a color filter array in accordance with the present 
invention; 

FIG. 3 is a cross-sectional view taken along the lines 3-3 of an area image sensor FIG. 2 and shown in schematic 
form including the arrangement of dye-receiving layers; 

FIG. 4 is a plan view of the embodiment shown in FIG. 2 with subscript numbers added to show rows and columns; 
and 

FIG. 5 is a plan view of another embodiment of a kernel of a color filter array in accordance with the present inven- 
tion. 

FIG. 1 is a plan view of a new four-color CFA kernel. The colors are chosen so that V = (A+B)/2 = (C+D)/2 , where 
V is luminance. By use of the term "kernel" is meant a minimal repeating pattern of color pixels of a CFA filter that is 
two-dimensionally replicated over the full extent of the color filter array. In a preferred embodiment set of colors is A = 
magenta (M), B = green (G), C = cyan (C) and D = yellow (Y). Expressing this set of colors in terms of red (R) oreen 
(G) and blue (B): 

M = (R+B)/2 

G = G 
C = (G+B)/2 
Y = (R+G)/2 

Under these definitions, V = (R+2G+B)/4 . This preferred embodiment is shown in FIG. 2 wherein the pattern has 
green, magenta, and yellow pixels. 

FIG 3 is a cross-sectional view of an area image sensor 10 taken along the lines 3-3 of FIG. 2. As shown, the 
image sensor 10 includes a silicon substrate 12 into which is doped pixel areas 14. In this particular embodiment, there 
are two dye-receiving layers 1 6 and 1 8 respectively formed on the silicon substrate 1 2. In this arrangement, the dye pat- 
tern shown in FIG. 2 is exemplified. It should be noted that a yellow portion is disposed directly over a cyan dye portion. 
These portions are aligned with a particular image sensor pixel. The combination of the yellow and cyan portions forms 
the green pixels shown in FIG. 2. Although the superimposed cyan and yellow colored portions are preferably the same 
cyan and yellow dyes shown in the dye-receiving layers 16, it will be understood by those skilled in the art that different 
cyan and yellow dyes can be used to form a green pixel. For an example of a color filter array which uses different color 
dyes, see commonly assigned US-A-5,4 19,990. 

Due to the arrangement of color filter array pattern shown in FIG. 2, V can be interpolated in four distinct directions 
at each location in the CFA. This produces a rich set of predictors that can be used by adaptive CFA interpolation rou- 
tines. In FIG. 4, the same color pixel kernel shown as in FIG. 2; however, in FIG. 4 each of the pixels carry a subscript 
number The first number in the subscript corresponds to the row and the second subscript corresponds to the column. 
For clarity of illustration, FIG. 4 has been shows as a 5x5, although the kernel, of course, is still 4x4. Most notably, at 
each location in the pattern, V can be estimated in the horizontal, vertical, positive slope diagonal and negative slope 
diagonal directions. The value V 33 can be calculated as below: 

V 33 - (Y3i+2C3 2 +2G33+2M 34 +Y3 5 )/8 (Eqs. 1) 

v 33 - (C 1 3+2Y 2 3 + 2G 3 3 + 2M 4 3 + C 5 3)/8 
V33 = (M l5 +2C 24+ 2G 33+ 2Y 42+ M 51 )/8 
v 33 = (M 11 +2M 22 +2G 33 +2G 44 +M 55 )/8 

Two chrominance channels are also defined for this pattern: C, = K^D-C) and C 2 = K 2 (A- B) . The values and 
K 2 are scaling constants. In the preferred embodiment of FIG. 2, K A = 1 , K 2 = 1/2 and, as before, A = M, B=G, C = C 
and D = Y As a result, once a luminance value has been calculated tor each pixel location, d or C2 can be calculated 
directly. Missing values of and C 2 can be interpolated in standard ways well understood by those in the art, for exam- 
ple, using the average of two neighboring pixels. 

Once there is a value of V, C, and C<> at each pixel location, corresponding values of R. G and B can be obtained 
through a simple linear transform. 

In accordance with the above discussion, A and B are defined to be companion colors in that the sum of the colors 
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is proportional to luminance and the difference of the colors is proportional to chrominance. Likewise, C and D are also 
companion colors. 

FIG 5 shows an alternative embodiment of the present invention. It should be noted that the kernel pattern of FIG. 
5 is similar to that shown in FIG. 2 with the exception that the cyan pixels are replaced by yellow pixels and the yellow 
pixels are replaced by cyan pixels. It should now be clear that these colors can be handled in a similar fashion using 
Equations 1 . 



Parts List 



10 10 image sensor 

12 silicon substrate 

14 pixel areas 

16 dye-receiving layers 

18 dye-receiving layers 

75 

Claims 

1 . A color filter array for an image sensor which has a plurality of pixels, a color filter array comprising: 

20 (a) a plurality of color pixel kernels, with each kernel having a plurality of pixels arranged in the following pattern 
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(i) wherein X A and X 2 respectively represent luminance values wherein the sum of their individual colors 
are luminance and difference of their individual colors are chrominance; and 

(ii) wherein and Y 2 respectively represent luminance values wherein the sum of their individual colors 
are luminance and difference of their individual colors are chrominance 

2. A color filter array for an image sensor which has a plurality of pixels, a color filter array comprising: 

(a) a plurality of color pixel kernels, with each kernel having a plurality of pixels arranged in the following pattern 
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wherein: 

A and B are companion colors; and 
C and D are companion colors. 

3. A color filter array for an image sensor which has a plurality of pixels, a color filter array comprising: 

(a) a plurality of color pixel kernels, with each kernel having a plurality of pixels arranged in the following pattern 
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w wherein: 

M is magenta; 
G is green; 
C is cyan; and 
is Y is yellow. 

4. A color filter array for an image sensor which has a plurality of pixels, a color filter array comprising: 

(a) a plurality of color pixel kernels, with each kernel having a plurality of pixels arranged in the following pattern 

20 



M 


G 


Y 


C 


G 


M 


C 


Y 


C 


Y 


G 


M 


Y 


C 


M 


G 



wherein: 

30 

M is magenta; 
G is green; 
C is cyan; and 
Y is yellow. 

35 
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(54) A particular pattern of pixels for a color filter array which is used to derive luminance and 
chrominance values 

(57) A color filter array for an image sensor which 
has a plurality of pixels is disclosed. The color filter array 
includes a plurality of color pixel kernels, with each ker- 
nel having a plurality of pixels arranged in the following 
pattern 
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M is magenta; 
G is green; 
C is cyan; and 
Y is yellow. 
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